Predictive Distillation Method of Anchor-Free Object Detection Model for Continual Learning

نویسندگان

چکیده

Continual learning (CL) is becoming increasingly important, not only for storage space because of the ever-increasing amount data being generated, but also associated copyright problems. In this study, we propose ground truth’ (GT’), which a combination truth (GT) and prediction teacher model that distills results previously trained model, called by applying knowledge distillation (KD) technique to an anchor-free object detection model. Among all objects predicted score higher than threshold value distilled into current student To avoid interference with new class learning, IoU obtained between every GT objects. Through continual scenario, even if reuse past limited, are sufficient, proposed minimizes catastrophic forgetting problems enables newly added classes. The was learned in PascalVOC 2007 + 2012 tested PascalVOC2007, better 9.6% p mAP 13.7% F1i shown scenario 19 1. result 15 5 showed compared algorithm, 1.6% 0.9% F1i. 10 outperformed other alternatives, 0.6%

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Model Predictive Inferential Control of a Distillation Column

Typical production objectives in distillation process require the delivery of products whose compositions meet certain specifications. The distillation control system, therefore, must hold product compositions as near the set points as possible in faces of upset. In this project, inferential model predictive control, that utilizes an artificial neural network estimator and model predictive cont...

متن کامل

Learning Efficient Object Detection Models with Knowledge Distillation

Despite significant accuracy improvement in convolutional neural networks (CNN) based object detectors, they often require prohibitive runtimes to process an image for real-time applications. State-of-the-art models often use very deep networks with a large number of floating point operations. Efforts such as model compression learn compact models with fewer number of parameters, but with much ...

متن کامل

Episodic memory for continual model learning

Both the human brain and artificial learning agents operating in real-world or comparably complex environments are faced with the challenge of online model selection. In principle this challenge can be overcome: hierarchical Bayesian inference provides a principled method for model selection and it converges on the same posterior for both off-line (i.e. batch) and online learning. However, main...

متن کامل

Sample Distillation for Object Detection and Image Classification

We propose a novel approach to efficiently select informative samples for large-scale learning. Instead of directly feeding a learning algorithm with a very large amount of samples, as it is usually done to reach state-of-the-art performance, we have developed a “distillation” procedure to recursively reduce the size of an initial training set using a criterion that ensures the maximization of ...

متن کامل

A Hybrid Machine Learning Method for Intrusion Detection

Data security is an important area of concern for every computer system owner. An intrusion detection system is a device or software application that monitors a network or systems for malicious activity or policy violations. Already various techniques of artificial intelligence have been used for intrusion detection. The main challenge in this area is the running speed of the available implemen...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Applied sciences

سال: 2022

ISSN: ['2076-3417']

DOI: https://doi.org/10.3390/app12136419